A general construction for abstract interpretation of higher-order automatic differentiation

نویسندگان

چکیده

We present a novel, general construction to abstractly interpret higher-order automatic differentiation (AD). Our allows one instantiate an abstract interpreter for computing derivatives up chosen order. Furthermore, since our reduces the problem of reasoning about real-valued straight-line programs, it can be instantiated with almost any numerical domain, both relational and non-relational. formally establish soundness this construction. implement technique by instantiating non-relational interval domain zonotope compute first derivatives. In latter case, we are apply abstracting derivatives, hence also interpretation work track correlations across not only different variables, but orders evaluate these instantiations on multiple case studies, namely robustly explaining neural network more precisely network’s Lipschitz constant. For robust interpretation, second computed via AD 4.76× 6.98× precise, respectively, compared AD. certification, obtain bounds that 11,850× precise zonotopes, state-of-the-art interval-based tool.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relational Abstract Interpretation of Higher Order Functional Programs (extended abstract)

Most applications of the abstract interpretation framework[2] have been for analyzing functional programs use functions on abstract values to approximate functions, thus assuming that functions may be called at all arguments. When the abstract domain is finite, this approach can easily be generalized to higher order functional languages as shown for example by [1]. In practice this leads to com...

متن کامل

Automatic Construction of Hoare Proofs from Abstract Interpretation Results

Interpretation Results Sunae Seo, Hongseok Yang, and Kwangkeun Yi 1 Department of Computer Science, Korea Advanced Institute of Science and Technology [email protected] 2 MICROS Research Center, Korea Advanced Institute of Science and Technology [email protected] 3 School of Computer Science and Engineering, Seoul National University [email protected] Abstract. By combining program lo...

متن کامل

Higher Order Abstract Interpretation with Flow-Effect Types

This paper describes a novel flow-effect type system that combines concepts of type constraint systems and type effect systems, to achieve a flow-sensitive abstract interpretation of programs with higher-order functions. We prove that a decidable, safe closure algorithm exists. Deriving a decidable type closure algorithm in the presence of higher-order recursive functions is the main technical ...

متن کامل

Automatic Verification by Abstract Interpretation

We discuss the use of abstract interpretation in the context of automatic program veri cation requiring precise abstractions. We compare entirely manual versus user-guided abstractions ranging from program-speci c abstractions including predicate abstraction to the systematic design of abstract domains and iteration strategies. 1 Abstract Interpretation Theory Abstract interpretation theory [1,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ACM on programming languages

سال: 2022

ISSN: ['2475-1421']

DOI: https://doi.org/10.1145/3563324